adaptive soft weight tying
Adaptive Soft Weight Tying using Gaussian Mixtures
One way of simplifying neural networks so they generalize better is to add an extra t.erm 10 the error fUll ction that will penalize complexit.y. C nder this model, a set of weights is simple if the weights can be clustered into subsets so that the weights in each cluster have similar values . We allow the parameters of the mixture model to adapt at t.he same time as t.he network learns. Simulations demonstrate that this complexity term is more effective than previous complexity terms.
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.32)
Country:
- North America > Canada > Ontario > Toronto (0.14)
- North America > United States > Pennsylvania > Allegheny County > Pittsburgh (0.05)
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- (2 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.67)
Country:
- North America > Canada > Ontario > Toronto (0.14)
- North America > United States > Pennsylvania > Allegheny County > Pittsburgh (0.05)
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- (2 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.67)
Country:
- North America > Canada > Ontario > Toronto (0.14)
- North America > United States > Pennsylvania > Allegheny County > Pittsburgh (0.05)
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- (2 more...)
Technology: Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (0.67)